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(54) Sound controller that generates sound responsive to a situation 



(57) A sound controller has a volume controller, 
which adjusts the output level of a sound processor unit, 
and a CPU, which sets the gains (or ON/OFF condition) 
of the volume controller responsive to a scene or situa- 



tion in a video game, thereby enabling generation of 
sound that is responsive to individual scenes and situ- 
ations in the video game, and enabling effective audible 
enactment for a user of various scenes and situations 
in the video game. 
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Description 

[0001] This application is related to Japanese Patent 
Application No, 2000-398705 filed on Decennber 27, 

2000, and No. 2001-349837 filed on November 15, 5 

2001 , based on which this application claims priority un- 
der the Paris Convention and the contents of which are 
incorporated herein by reference. 

BACKGROUND OF THE INVENTION w 

1 . Field of the Invention 

[0002] The present invention relates to a sound con- 
troller, a sound control method, a sound control program is 
to be executed on a computer, a computer-readable 
storage medium having stored therein the sound control 
program, and a program execution apparatus for exe- 
cuting the sound control program, all of which are pref- 
erably applicable to a video game machine or an enter- 20 
tainment system having video game functions. 

2. Description of the Related Art 

[0003] Video game machines, which execute a video 
game based on a game program stored in a storage me- 
dium such as a CD-ROM, DVD-ROM or semiconductor 
memory are currently in widespread use. 
[0004] In the video game machine, by operating a 
controller connected to the main video game machine 30 
unit, characters displayed on a display screen are oper- 
ated, thereby enabling the playing of various video 
games, such as RPGs (role-playing games), AVGs (ad- 
venture games), or SLGs (simulation games). 
[0005] In many video games, background music as a 35 
main theme song of the game is formed, such back- 
ground music being output from, for example, a speaker 
unit of a television receiver. It is thus possible to enjoy 
the operation of characters and the like in a video game 
while listening to the background music. 40 
[0006] In a conventional video game, however, 
whereas background music should be output while play- 
ing the game, the same volume level of background mu- 
sic was output, regardless of the current scene of the 
game. For this reason, there was the problem of a lack 45 
of a dramatic effect in the video game. 
[0007] For example, although the situation in which a 
character is outside and that in which the character is 
inside are different situations, if the same volume level 
of background music is output in both situations, it is not 50 
possible to audibly impart a feeling of tension, reality, 
and stimulus to the player, thereby preventing effective 
staging of the drama of each particular scene. 

SUMMARY OF THE INVENTION 55 

[0008] Accordingly, it is an object of the present inven- 
tion, in consideration of the above-noted problems in the 



conventional art, to provide a sound controller, a sound 
control method, a a computer program product. In the 
following also referred to as a sound control program to 
be executed on a computer, a computer-readable stor- 
age medium having stored therein the sound control 
program, and a program execution apparatus for exe- 
cuting the sound control program, all of which enable 
generation of sound that effectively portrays the drama 
of each scene in a video game. 

[0009] In the present invention, sound source infor- 
mation of each channel is reproduced, based on se- 
quence information that controls the sound source re- 
producing operation on each channel, and the output 
level of the reproduced sound source information is ad- 
justed, responsive to at least scene or situation. 
[0010] It is thus possible to, for example, audibly im- 
part a feeling of tension, reality, and stimulus to the play- 
er of the video game, thereby enabling effective staging 
of the drama of each scene in the video game. 
[0011] Other and further objects and features of the 
present invention will become upon understanding of 
the illustrative embodiments about to be described in 
connection with the accompanying drawings or will be 
indicated in the appended claims, and various advan- 
tages not refereed to herein will occur to one skilled in 
the art upon employing of the invention in practice. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0012] 

Fig. 1 is an oblique view showing the outer appear- 
ance of an entertainment system that is an embod- 
iment of the present invention: 
Fig. 2 is a block diagram showing the entertainment 
system according to the embodiment of the present 
invention; 

Fig. 3 is a functional block diagram showing the a 
sound processor unit provided in the entertainment 
system according to the embodiment of the present 
invention; and 

Fig. 4 is a table illustrating examples of sound vol- 
ume adjustment operations in the entertainment 
system according to the embodiment of the present 
invention. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[0013] Various embodiments of the present invention 
will be described with reference to the accompanying 
drawings. It is to be noted that the same or similar ref- 
erence n umerals are applied to the same or similar parts 
and elements throughout the drawings, and the descrip- 
tion of the same or similar parts and elements will be 
omitted or simplified. 
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Configuration of an Embodiment of the Present 
Invention 

[0014] The present invention can be applied to an en- 
tertainment system having video game functions as 
shown in Fig. 1 . This entertainment system has a main 
unit 1 and a controller 2 connected to the main unit 1 . 

Configuration of the Main Unit 

[0015] The main unit 1 has a disk tray 3, on which an 
optical disk such as a CD-ROM or DVD-ROM having 
stored therein a video game program, sound infomnation 
such as sound of a character or effective sound, and 
music infomnation such as a background music (BGM) 
for the video game is loaded, and a reset button 4 for 
specifying reset and the like of the operation of the main 
unltl. 

[0016] The main unit 1 has two USB (Universal Serial 
Bus) connectors 5, an IEEE (Institute of Electrical and 
Electronics Engineers) 1394 connector 6, controller 
ports 7A and 7B to which the controllers 2 are connect- 
ed, memory card slots 8A and 88 into which memory 
cards 26 for storing game contents up to the point at 
which playing of a video game was interrupted are in- 
serted, and an eject button 9 for specifying ejection of 
the optical disk loaded on the disk tray 3. 
[0017] Although not shown in the drawing, the main 
unit 1 is provide on its rear panel with a power switch, 
an audio/video output temiina! (AV multi-output temni- 
nal), a PC card slot, an optical digital output tenninal, 
and an AC line input temrtinal or the like. A television 
receiver 1 0 used as a monitor is connected to the main 
unit 1 via the AV multi-output temainal, so that it not only 
displays a game screen of the video game, but also out- 
puts through a speaker units 11 thereof sounds of a 
character, effective sound or background music, of the 
video game. 

Controller Configuration 

[0018] The controller 2 has a left grip 35 gripped and 
held within the palm of the left hand of the player, a right 
grip 36 gripped and held within the palm of the right hand 
of the player, a left operating part 21 and a right operat- 
ing part 22, which are each operated by the thumbs of 
the left and right hands, respectively, while the grips 35 
and 36 being gripped by the left and right hands of the 
player, respectively, a ieft analog operating part 31 and 
a right analog operating part 32, which have joysticks 
enabling analog operation (joystick operation) by the (eft 
and right thumbs, a first ieft pushbutton 23L and a first 
right pushbutton 23R, which are operated by pressing 
by the left and right index fingers, respectively, and a 
second left pushbutton and a second right pushbutton 
(not shown), which are provided below the first left and 
right pushbuttons 23L and 23R, respectively, and which 
are operated by the middle fingers of the left and right 



hands, respectively. 

[0019] The above-noted left operating part 21 is pro- 
vided with "up", "down", "left" and "right" direction keys, 
used, for example, when a player moves a character, 

5 for example, to up, down, left, and right directions re- 
spectively on the screen. The "up", "down", "left" and 
"right" direction keys are used not only to issue "up", 
"down", "left" and "right" direction commands, but can 
also be used for issuing commands for an oblique direc- 

fo tion. For example, if the "up" key and the "right" key are 
pressed simultaneously, it is possible to issue a com- 
mand for the upper-right direction. The same is true of 
the other direction keys. For example, if the "down" di- 
rection key and the "left" direction key are pressed si- 

'5 multaneously a command is given for the lower-left di- 
rection. 

[0020] The right operating part 22 has four command 
buttons (these buttons being respectively marked by en- 
graved m A, X, and o marks), to which different func- 

20 tions are assigned by a game application program. 
[0021 ] The above-noted joysticks are capable of pre- 
cession in response to analog operations by the ieft and 
right analog operating parts 31 and 32. When they are 
standing upright (that is, when they are not operated so 

25 as to impart an inclination thereto), the position thereof 
is held in the vertical attitude (reference position) con- 
dition in which they are not inclined from the vertical, 
and when they are operated so as to impart an inclina- 
tion thereto, coordinate values on an X-Y coordinate are 

30 detected based on the amount of inclination with respect 
to the reference position and the direction of the inclina- 
tion, such detected coordinate values being supplied to 
the main unit 1 as the operation output. 
[0022] The controller 2 is further provided with a mode 

35 selection button 33 for switch ing between the analog op- 
erating mode and the digital operating mode, a light in- 
dicator 34 for notifying a player, for example by lightning 
of an LED (light-emitting diode) or the like, of the oper- 
ating mode selected by the mode selection button 33, a 

40 start button 24 for giving commands for starting, pausing 
or reproducing a game, and a select button 25 for in- 
structing display of a menu orthe operating panel on the 
television receiver 11 . 

[0023] When the mode selection button 33 is used to 
45 select the analog operating mode, the light indicator 34 
is controlled so as to light, and the lett and right analog 
operating parts 31 and 32 are activated. When the digital 
operating mode is selected, the light indicator 34 is ex- 
tinguished and operation of the left and right analog op- 
50 erating parts 31 and 32 are deactivated. 

[0024] In addition, the controller 2 is provided within 
the left grip 35 and the right grip 36 with a vibration gen- 
erating mechanism which generates a vibration, for ex- 
ample by causing a weight that is eccentrically disposed 
55 with respect to a motor to rotate, thereby enabling op- 
eration of the vibration generating mechanism in re- 
sponse to a command from the main unit 1 when a char- 
acter being damaged, for example. By doing this, it is 
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possible to impart a vibration to the hands of a player 
holding the controller 2, thereby making playing the 
game morefun. When the various buttons and operating 
parts provided on the controller 2 are operated by the 
player, the controller 2 generates an operating signal 5 
corresponding to the operation, such operating signal 
being supplied to the main unit 1 via a cable 13 and a 
controller connecting portion 12. 

Electrical Configuration of the Main Unit io 

[0025] As shown in Fig. 2, the main unit 1 has a main 
CPU 100 for perfomning signal processing and control 
of internal constituent elements, based on various pro- 
grams such as a game application program, a graphic ^5 
processing unit (GPU) 110 for perfonnlng image 
processing, an IO processor (lOP) 120 for performing 
interface processing between the main unit 1 and an ex- 
ternal device such as the controller 2 and the memory 
card 26 or the like, a mechanical controller 1 90 for per- 20 
fomning reproduction control of the optical disk 130 such 
as a DVD-ROM or CD-ROM onto which an application 
program or multi-media data is stored, a main memory 
(RAM) 160 which includes functions as a working area 
for the main CPU 100 and a buffer for temporary storing 25 
data read out from the optical disk 130, a MASK-ROM 
150 into which an operating system program executed 
by the main CPU 100 or the lOP 120 is mainly stored, 
and a sound processor unit (SPU) 140 for performing 
audio signal processing. 30 
[0026] The main unit 1 has a CD/DVD digital signal 
processor 170 (DSP) responsible for en^or correction 
processing (CIRC processing) of reproduction output 
from the optical disk 130 supplied via an RF amplifier 
131, and responsible for expanding and decoding 35 
processing of compressed coded data; a driver 180 and 
the mechanical controller 190 for controlling rotation of 
a spindle motor 132, focus and tracking control of an 
optical pickup 133, and loading control of the disk tray; 
and a card-type connector (PC card slot) 200 for con- 40 
necting, for example, a communication card or an ex- 
ternal hard disk drive or the like. 
[0027] These various elements are mutually connect- 
ed via bus lines 202 and 203 or the like. The connection 
between the main CPU 100 and the graphic processor ^5 
1 1 0 is made by a dedicated bus line, and the connection 
between the main CPU 100 and the lOP 120 is made 
by a sub-bus SBUS. The lOP 120 is connected to the 
CD/DVD digital signal processor 170, the MASK-ROM 
150, the sound processor unit (SPU) 140, and the card- so 
type connector 200 by an SBUS. 

[0028] The main CPU 1 00, by executing an operating 
system program for the main CPU stored in the 
MASK-ROM 150, controls the overall operation of the 
main unit 1. The main CPU 100, by executing various 55 
application programs read out from the optical disk 1 30 
and loaded into the main memory 160. or by executing 
various application programs downloaded via a commu- 



nication network, also controls the operation of a video 
game in the main unit 1. 

[0029] The lOP 120. by executing an operating sys- 
tem program therefor stored in the MASK-ROM 150, 
performs such tasks as input/output of a signal sent from 
the controller 2 in response to operation by a player and 
data sent from the memory card 26 for storing game set- 
tings, in addition to control of input/output of data at a 
USB connector (not shown), at an IEEE 1 394 connector, 
or at a PC card slot or the like, and data protocol con- 
version. 

[0030] The MASK-ROM 150 can store device IDs for 
the controllers 2 connected to the controller ports 7A and 
7B, the memory cards 26 connected to the memory card 
slots 8A and SB, and PC cards and the like connected 
to the card-type connector (PC card slot) 200, and the 
lOP 200 perfomris communication with devices such as 
the above-noted controllers 2, the memory cards 26 or 
the like, in accordance with such device IDs, to thereby 
specify the extemal devices such as the controller 2 or 
the memory card or the like, which are connected to the 
main unit 1 . 

[0031 ] The graphrc processor unit 1 1 0 performs draw- 
ing in accordance with drawing instmctions from the 
main CPU 1 00, and stores drawn images in a frame buff- 
er (not shown) . The graphic processor unit 1 1 0 also has 
a function as a geometry transfer engine responsible for 
processing such as coordinate transfer. 
[0032] That is, the graphki processor unit 1 1 0, in serv- 
ing as a geometry transfer engine, in the case in which 
an application program such as a video game stored in 
the optical disk 130 uses so-called three-dimensional 
(3D) graphics, constructs virtual three-dimensional ob- 
jects which are fonned by a set of triangular polygons. 
The graphic processor unit 110 also performs various 
calculations for generating an image possibly obtained 
by photographing such three-dimensional object with a 
virtual camera, that is, the perspective conversion for 
rendering (calculations of coordinate value for the case 
in which the vertices of each polygon making up a three- 
dimensional object are projected onto a virtual screen). 
[0033] The graphic processor unit 1 1 0, in accordance 
with drawing instructions from the main CPU 100. per- 
forms rendering of three-dimensional objects to gener- 
ate an image with respect to the frame buffer while mak- 
ing use, If necessary, of the geometry transfer engine. 
The graphic processor unit 110 outputs a video signal 
responsive to such generated images. 
[0034] The sound processor unit 1 40 has an ADPCM 
decoding function for reproducing sound data which 
were processed by adaptive predictive coding, a repro- 
ducing function for reproducing and outputting audio 
signals such as effective sound or the.like by reproduc- 
ing waveform data stored in a sound buffer built in such 
unit 1 40 or extemally attached thereto, and a modulation 
function for modulating and reproducing the wavefomn 
data stored in the sound buffer 

[0035] The sound processor unit 140 thus provided 
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with such functions can be used as a so-called sannpling 
sound source, which can generate audio signals of mu- 
sic sound and effective sound and the like fronn the 
waveform data stored in the sound buffer, based on in- 
structions from the CPU 100. 

Overall Video Game Execution 

[0036] First, when the main power supply of a main 
unit 1 configured as described above is switched on, an 
operating system program for the main CPU and an op- 
erating system program for the lOP are each read out 
from the MASK-ROM 150, the main CPU 100 and the 
lOP 120 executing each corresponding operating sys- 
tem program. By doing this, the main CPU 1 00 perfomns 
overall control of the main unit 1, and the lOP 120 per- 
fomns input/output signal control between the controller 
2 and the memory card 26 or the like. 
[0037] When the main CPU 1 00 executes its operat- 
ing system program, after perfomning initialization 
processing such as a verification of operation, it reads 
out an application program for a game or the like record- 
ed on the optical disk 1 30 and, after loading the program 
in the main memory 1 60, then executes such program. 
[0038] By execution of the game application program, 
the main CPU 100 controls the graphic processor unit 
110 and the sound processor unit 140, responsive to 
player's commands input by a controller 2 via the lOP 
120, so as to perform control of image display, effective 
sound, and music (background music). 

Sound Control Configuration 

[0039] Next, the entertainment system according to 
this embodiment controls the sound processor unit 140 
so as to control the generation of effective sound or 
background music, thereby providing sounds appropri- 
ate to each scene of the video game. 
[0040] Fig. 3 is a functional block diagram showing the 
concept of the sound processor unit 140, from which 
drawing it can be seen that the sound processor unit 
140 has a sound driver 50, a tone generator 51, and a 
D/A converter 52. 

[0041] The sound driver 50 has a sequencer 55 for 
controlling sound generation of sound source data, 
based on sequence data such as MID! (Musical Instru- 
ment Digital Interface) data or the like, a plurality of 
sound source reproducing channels 56(Channel 0 to 
Channel 1 5 in Fig. 3) for reproducing sound source data 
( VAB) supplied from the tone generator 51 under control 
of the sequencer 55, a plurality of volume controllers 57 
for performing volume control of the reproduction output 
of such reproduced sound source data, and a D/A con- 
verter 52 for converting the reproduction output of the 
sound source data from the volume controllers 57 to an- 
alog form and supplies same, for example, to a speaker 
units 11 of a television receiver 10. 
[0042] The sound source data reproduced by each of 



the sound source reproducing channels 56 is usually 
output at predetemriined volume level for each channel. 
In an entertainment system according to this embodi- 
ment of the present invention, the volume controller 57 

5 is provided between each of the sound source repro- 
ducing channels 56 and the D/A converter 52. The CPU 
100 controls the gains of the volume controllers 57 to 
thereby control the sound output from each of the sound 
source reproducing channels 56 to its predetermined 

^0 volume level. 

[0043] In the example shown, the sound processor 
unit (SPU) 140 is shown as having a total of 16 sound 
source reproducing channels 56, Channel 0 through 
Channel 15, and this will be the basis for the description 

15 below as well. It will be understood, however, that this 
is merely one example of the number of channels, and 
that the number of channels can be arbitrarily estab- 
lished, thus making it possible to have a design having, 
for example, 48 channels. 

20 

Sound Control Operation 

[0044] First, when the video game is started, the CPU 
100 extracts the sequence data and the sound source 

25 data (VAB) from the overall game program read from 
the optical disk 130, supplies the sequence data to the 
sequencer 55 of the sound driver 50, and supplies the 
sound source data to the tone generator 51. The tone 
generator 51 supplies each of the sound source data to 

30 the corresponding sound source reproducing channel 
56. 

[0045] In just one example, the sequence data, as 
shown in Fig. 3, Is/ormed so that the sequence data for 
the sound source reproducing channels 56 is arranged 

35 parallel in time sequence such as Channel 1 , Channel 

2, Channel 3, Channel 4, Channel 5 the sequencer 

55, in accordance with the sequence data, performing 
drive control of the specified sound source reproducing 
channel 56. By doing this, sound source data supplied 

40 to the sound source reproducing channels 56 driven by 
the sequencer 55 is reproduced and supplied to the cor- 
responding volume controllers 57. 
[0046] In this case, the optical disk 130 has recorded 
volume control infonnation indicating the volume levels 

45 of each of the volume controllers 57 for each scene and 
situation in a video game. The CPU 100 controls the 
gains of each of the volume controllers 57 in accordance 
with the volume control information for each game 
scene and situation. 

50 [0047] By doing this, the reproduction output level of 
the sound source data supplied to each volume control- 
ler 57 is changed appropriately for each scene or situa- 
tion, converted to analog fomi by the D/A converter 52, 
and supplied to the speaker units 11 of the television 

55 receiver 10, thereby achieving a sound output at volume 
that is responsive to each scene or situation in a game. 
[0048] More specifically, Fig. 4 is a table showing the 
drive conditions for the volume controllers 57 corre- 
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spending, for exannple, to the situation in which a main 
character of a game is outside and the situation in which 
the main character is inside. 

[0049] The channel assignments in the example 
shown in Fig. 4 are as follows. 

The sound source reproducing channel 56 for 
Channel 0 is "industrial se"; 

The sound source reproducing channel 56 for 
Channel 1 is "Drum Kit"; 

The sound source reproducing channel 56 for 
Channel 2 is "Move"; 

The sound source reproducing channel 56 for 

Channel 3 is "Fretless Bass"; 

The sound source reproducing channel 56 for 

Channel 4 is "Nylon Guitar"; 

The sound source reproducing channel 56 for 

Channel 5 Is "pad"; 

The sound source reproducing channel 56 for 
Channel 6 is "Vib"; 

The sound source reproducing channel 56 for 
Channel 7 is "Pizz"; 

The sound source reproducing channel 56 for 
Channel 8 is "Flute"; 

The sound source reproducing channel 56 for 
Channel 9 is 'Toy Piano"; 

The sound source reproducing channel 56 for 
Channel 10 is "strings vaii"; 

The sound source reproducing channel 56 for 

Channel 11 is "Accordion vari"; 

The sound source reproducing channel 56 for 

Channel 12 is "Flute Delay"; 

The sound source reproducing channel 56 for 

Channel 13 is "Toy Piano vari"; 

The sound source reproducing channel 56 for 

Channel 14 is "Drum Kit vari"; 

The sound source reproducing channel 56 for 

Channel 15 is "industrial se vari". 

[0050] Thus, each of the sound source reproducing 
channels 56 is assigned a particular part (musical instru- 
ment). 

[0051] The "Bank No." is 0 for Channel 0 through 
Channel 4, Channel 14, and Channel 15, and is 1 for 
Channel 5 through Channel 13. 

[0052] The sound source reproducing channels 56 for 
each of the channels are driven based on the above- 
noted sequence data, and when the CPU 100 detects 
that the main character is at a location that is outside 
within a virtual space, the CPU 1 00 performs drive con- 
trol so as to switch the volume controllers 57 corre- 
sponding to Channel 0 through Channel 9 and Channel 
1 2 each to ON, and so as to switch the volume control- 
lers 57 corresponding to Channel 10, Channel 11, and 
Channel 1 3 through Channel 15 to MUTE (OFF) , based 
on the volume control infomnation. 
[0053] By doing this, the background music formed 
with the sound source data reproduced by the sound 



source reproducing channels 56 corresponding to 
Channel 0 through Channel 9 and Channel 12 is output 
through the speaker units 1 1 of the television receiver 
10. In this case, because there are a large number of 

5 volume controllers 57 that are switched to ON. the back- 
ground music is output at high volume. 
[0054] in contrast to the above, if the C PU 1 00 detects 
that the main character is at a location that is inside with- 
in the virtual space, the CPU 1 00 perfomns drive control 

10 so as to switch the volume controllers 57 corresponding 
to Channel 4, Channel 6, Channel 1 0, Channel 1 1 , and 
Channel 13 through Channel 15 each to ON, with the 
volume controllers 57 corresponding to the remaining 
channels switched to MUTE (OFF), based on the vol- 

'5 ume control infonnation. 

[0055] By doing this, because there are a smaller 
number of volume controllers outputting the sound 
source data than In the case when the main character 
is outside, the background music is output at lower vol- 

^0 ume. 

[0056] If volume control is perfonned in this manner, 
for example whereas in the case in which the main char- 
acter is outside, not only are crowd noise and other nois- 
es output together with the background music output at 
25 predetemnined volume, when the main character is 
moved inside, crowd and other noises almost cannot be 
heard, and the volume of the background music is low- 
ered. 

[0057] For this reason, it is possible to audibly provide 
30 a player with a sense of tension, reality, and stimulus, 
responsive to individual scenes and situations, thereby 
enabling an effective enactment of each scene or situ- 
ation. 

[0058] Although Fig. 4 shows the case in which the 

35 volume controllers 57 corresponding to each channel 
are controlled in two-ways, that of ON and that of MUTE 
(OFF), it will be understood that it is further possible to 
perform step-wise adjustment of the volume level be- 
tween more steps than merely ON and OFF 

40 [0059] Also, although the foregoing description was 
for an example in which the sound volume adjustment 
operation was perfonned to adapt to two conditions, that 
in which the main character is outside and that in which 
the main character is inside, it will be understood that it 

45 Is also possible in fighting scenes to perform sound vol- 
ume adjustment responsive to the character's hit points 
(points of damage to the character). 
[0060] It is posstole, for example, to output back- 
ground musfc from a large number of channels when 

50 the main character is getting ahead in a fight, but to grad- 
ually reduce the number of channels outputting back- 
ground music when the main character is losing the 
fight, until finally background music is output from only 
a single channel. By doing this, it is possible to have the 

55 background music for cheering the player, so that the 
player can enjoy more exciting fight scene. 
[0061] Another possibility is to set a sound generator 
to a predetemnined object, such as a building or location 
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(for example, a department store or congested town ar- 
ea), and to perform volume adjustment so as to gradu- 
ally increase the sound volume as a character ap- 
proaches a building or location and the iike (or to apply 
MUTE to many channels at first and then gradually re- 
move the MUTE condition and change to the ON con- 
dition). By doing this, it is possible to gradually increase 
the sound output as the character approaches a building 
or location that is the sound generator, thereby enhanc- 
ing the feeling of reality in the video game. 
[0062J As is clear from the foregoing description, an 
entertainment system according to this embodiment of 
the present invention is provided with volume controllers 
57 that adjust the output levels of sound source data 
reproduced in accordance with sequence data such as 
MIDI data, the CPU 100 of the entertainment system 
setting the gains (or setting the ON/OFF condition) of 
the volume controllers 57 responsive to particular 
scenes or situations, thereby enabling effective enact- 
ment of the various scenes and situations occurring in 
a video game. 

[0063] Although the example described is one in 
which MIDI is used as the sequence data, it will be un- 
derstood that this is merely one example, and that it is 
possible to use other forms of sequence data. 
[0064] Finally, it should be noted that the foregoing is 
merely an exemplary embodiment of the present Inven- 
tion, and that the present invention is not restricted to 
this embodiment, it being possible to practice the 
present invention in various other fomis and variations 
within the scope of the technical concept of the present 
invention. 



Claims 

1 . A sound controller, comprising: 



12 

(Musical Instrument Digital Interface) information. 

4. A method for controlling sound, coniprising steps of: 

5 reproducing sound source information for each 

channel, in accordance with sequence informa- 
tion controlling a sound source reproducing op- 
eration for each channel; and 
adjusting an output level of the reproduced 
sound source infomnation, minimally respon- 
sive to a scene or a situation. 

5. The method for controlling sound according to claim 
4, further comprising a step of: 

15 

controlling output and non-output of the repro- 
duced sound source infonnation, minimally re- 
sponsive to a scene or a situation. 

6. The method for controlling sound according to claim 
4 or 5, further comprising a step of: 

reproducing the sound source information of 
each channel, in accordance with MIDI infor- 
mation acting as the sequence information. 

7. Computer program product, comprising computer 
program means adapted to perform the method 
steps as defined in anyone of claims 4 to 6 when 
being executed on a computer, digital signal proc- 
essor or the like. 

8. A computer readable storage medium having re- 
corded thereon a computer program product ac- 
cording to claim 7. 

9. A program execution apparatus for executing a 
computer program product according to claim 7. 



means for sound source reproduction, which 
reproduces sound source information for each 40 
channel, in accordance with sequence informa- 
tion controlling a sound source reproducing op- 
eration for each channel; and 
means for adjusting an output level of the sound 
source information reproduced by the sound 45 
source reproduction means, minimally respon- 
sive to a scene or a situation. 

2. The sound controller according to claim 1 , wherein 

the output level adjusting means performs 50 
control of output and non-output of the sound 
source information reproduced by the sound source 
reproduction means, minimally responsive to a 
scene or a situation. 

55 

3. The sound controller according to claim 1 or 2, 
wherein 

the sequence infomnation comprises MIDI 
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